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I.  INTRODUCTION 

Adaptive  arrays  based  on  the  LMS  algorithm  (1)  are  very  appealing 
as  a means  of  protecting  communication  systems  from  Interference  (2,3). 
These  antennas  can  automatically  track  desired  signals  and  simultan- 
eously null  interfering  signals.  Moreover,  they  can  do  this  using 
conformally  mounted  elements  on  an  irregular  surface,  such  as  an  air- 
craft. Possible  applications  of  adaptive  arrays  include  communication 
systems  subject  to  accidental  interference,  RFI  and  jamming. 

An  important  problem  with  adaptive  arrays,  however,  is  their  lim- 
ited dynamic  range.  Two  factors  restrict  the  dynamic  range  of  an  adap- 
tive array.  First,  there  are  equipment  limitations.  The  multipliers, 
amplifiers,  etc.,  in  the  LMS  feedback  loops  operate  properly  only  over 
a certain  range  of  signal  power.  However,  although  equipment  limita- 
tions are  very  real,  they  are  not  fundamental;  that  is,  they  are  not 
due  to  the  LMS  feedback  concept  itself.  Rather,  they  appear  because 
the  equipment  performance  does  not  match  the  mathematical  behavior 
of  the  LMS  algorithm.  Also,  it  is  possible  to  overcome  such  limita- 
tions with  improved  design. 

The  second  factor  limiting  dynamic  range  Is  more  fundamental, 
because  it  is  inherent  in  the  LMS  algorithm.  The  limitation  occurs 
because  the  speed  of  response  of  the  LMS  feedback  loop  depends  on  re- 
ceived signal  power.  The  array  responds  slowly  to  a weak  signal  and 
rapidly  to  a strong  signal.  This  situation  makes  it  difficult  to  ac- 
comodate a wide  range  of  signals  because.  In  most  applications  of  adap- 
tive arrays,  system  requirements  limit  both  the  minimum  and  maximum 
speed  of  response  of  the  array.  As  a result,  the  array  can  handle 
only  a limited  range  of  signal  power  without  exceeding  speed  of  re- 
sponse bounds. 


In  this  report  we  address  the  problem  of  variable  time  constants 
in  the  LMS  algorithm.  The  purpose  of  the  report  is  to  present  an  im- 
proved form  of  adaptive  array  feedback  loop  that  appears  to  solve  this 
problem.  The  feedback  loop  described  produces  the  same  steady-state 
weights  as  the  LMS  algorithm,  but  has  the  property  that  its  time  con- 
stants are  nearly  independent  of  signal  power. 

In  Section  II  of  the  report,  we  establish  notation  and  discuss 
the  time  constant  behavior  of  the  LMS  array.  In  Section  III,  we  de- 
termine an  "ideal"  control  law  for  the  adaptive  array.  In  Section 
IV,  we  describe  a feedback  loop  whose  performance  approximates  this 
ideal  control  law.  Section  V presents  an  example  showing  the  transient 
behavior  of  an  array  using  this  feedback  loop. 

II.  DYNAMIC  RANGE  LIMITATIONS  IN  THE  LMS  ARRAY 

An  LMS  adaptive  array  (1)  has  weights  controlled  by  the  gradient 
law 

cfw  * 

sr  = ~k\  £ c2(t)l  • 1 11  i2M  d> 

where  w.  is  the  ith  array  weight,  k is  a positive  constant,  M is  the 

I 9 th 

number  of  elements  in  the  array  and  vwJ  e (*)]  is  the  i component 
of  the  gradient  of  the  squared  error  signal.  The  error  signal  e(t) 
is  defined  by 

2M 

e(t)  * R(t)  - l wiXl(t),  (2) 

j-1  3 3 


where  R(t)  is  the  Reference  Signal  (or  "Desired  Response"  (1))  and 
Xj(t)  Is  the  1th  quadrature  signal  In  the  array.  Substituting  Equation 
(2)  in  Equation  (1)  yields 


which  corresponds  to  the  feedback  loop  shown  in  Figure  1 


OTHER  W; x i TERMS 


Figure  1.  The  LMS  feedback  loop 


By  substituting  Equation  (2)  into  Equation  (3)  and  collecting 
terms  involving  w^  on  the  left,  we  find  that  the  weights  in  an  LMS 
array  satisfy  the  system  of  differential  equations 


where  w is  the  weight  vector 


and  X is  the  signal  vector. 


x,(t) 

x9(t) 


>X-)M(t) 


The  matrix  XX  and  the  vector  XR ( t)  are  time-varying,  so  it  is  dif- 
ficult to  solve  Equation  (4)  exactly.  However,  for  most  applications 
of  adaptive  arrays,  w varies  slowly  compared  to  the  signals  xi (t)  and 
Rft)  and  one  may  obtain  approximate  solutions  to  Equation  (4)  by  re- 
placing XXT  and  XRft)  by  their  time  average  values.  Let  $ and  S denote 
these  averages: 


<J*  = XX', 


s = xKTtT  . ( 

With  this  substitution,  the  system  in  Equation  (4)  becomes 

+ 2K<fw  = 2kS,  ( 

which  has  constant  coefficients  and  may  be  solved  by  diagonalizing 
*.  The  solution  for  the  ith  weight  is 


wi  = A1.  e 
(9) 


-2kXit  -2kx7t 

+ Af  e 1 
2 


-2kX?Mt 

+ . . . + A.  e + Cj , 

’2M  1 


where  A.  , A.  , ....  A.  are  constants  determined  by  initial  condi- 
tions, xjtXj,,^...  X?M  a?e  the  eigenvalues  of  t,  and  c^  is  the  steady- 
state  value  of  w.. . We  note  that  the  time  constant  of  the  jth  exponen- 
tial term  is 

Tj = m;  • (10) 
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Thus,  system  requirements  usually  limit  the  allowable  range  of 
*MAX^*MIN‘  Because  Equation  (11),  there  is  then  a maximum  value 
of  I/N  that  the  system  can  accommodate.  In  the  author's  experience, 
this  value  is  usually  disappointingly  low.  One  is  often  forced  to 
accept  a design  that  does  not  meet  speed  of  response  requirements  in 
order  to  handle  even  a modest  value  of  I/N.  This  is  the  dynamic  range 
problem  in  the  LMS  array. 

III.  THE  IDEAL  CONTROL  LAW 

To  find  a way  to  correct  this  problem,  it  is  helpful  if  we  first 
examine  the  reason  for  time  constant  spread  in  a more  basic  way.  We 
will  observe  that  time  constant  spread  occurs  because  the  LMS  algorithm 
is  based  on  a gradient  approach.  A gradient  approach  causes  the  weight 
vector  to  move  along  some  parts  of  its  trajectory  at  a different  speed 
than  along  other  parts.  This  viewpoint  will  also  suggest  a way  of 
modifying  the  LMS  loop  to  solve  the  problem. 

We  may  use  a simple  two-dimensional  example  as  an  illustration. 
From  Equation  (2),  the  average  squared  error  may  be  written 


e*(t)  = R*(t) 


2w^S  + w^  4w 


Snin  + ("“"opt*  ®(w-Wopt>’ 


where 


"opt  ■ 


(12a) 


(12b) 


(13) 


is  the  weight  vector  yielding  minimum  e (t),  and 

w ^ - sT*'ls 


(14) 
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—p 

is  the  value  of  e (t)  when  w = w t.  (T  denotes  the  transpose.)  Con- 
sider  a two-dimensional  ec (t)-surface  defined  by 


1 0 


0 100 


The  resulting  e^(t)-surface  has  elliptical  loci  of  constant  e^(t)  in 
the  w-plane,  as  shown  in  Figure  2.  A typical  trajectory  traveled  by 
a weight  vector  under  the  LMS  algorithm  is  shown  in  Figure  2.  The 
weight  vector  starts  at  an  arbitrary  point  wQ  and  travels  to  wQpt  along 
the  curved  path  shown.  At  each  point  of  the  trajectory,  the  weights 
move  in  the-steepest-descent  direction,  which  is  always  perpendicular 

p 

to  a constant  e (t)  locus.  Since  the  eigenvalues  are  unequal,  the 
weights  do  not  move  in  a straight  line  toward  wQpt,  but  along  a curved 
path,  as  shown.  Moreover,  because  the  LMS  algorithm  makes  the  time 
rate  change  of  w proportional  to  the  slope  of  the  e^ft)-surface,  the 
weight  vector  moves  from  wQ  to  w^  in  Figure  2 rapidly,  since  the  slope 
is  large  in  this  region,  but  from  point  w^  to  wQpt  slowly,  because 
the  slope  is  small  in  this  region.  The  movement  from  wQ  to  w^  con- 
tributes a fast  term  to  the  weight  response,  and  the  movement  from 
W1  to  wopt  contributes  a slow  term. 

We  observe  that  the  spread  in  time  constants  would  be  eliminated 
if  the  weights  were  always  forced  to  move  in  a straight  line  toward 
wopt  a va^ue  °t  dw/dt  not  dependent  on  the  slope  of  the  surface. 
Such  a preferred  trajectory  is  shown  in  Figure  2.  This  preferred  tra- 
jectory is  in  the  vector  direction  -(w"wopt).  tor  any  given  w.  How- 
ever, the  gradient  of  e2(t),  as  computed  from  Equation  (12b),  is 
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so  the  LMS  algorithm  is 


— = -2k*  (w-w_Dt).  (18) 

dt  p 

I.e.,  the  LMS  algorithm  moves  the  weights  in  the  direction  of  the  vector 
-4>(w-w0pt) , not  in  the  direction  -(w-wopt).  Since  4>  has  unequal  eigen- 
values, -$(w-wop^. ) is  usually  in  a different  direction  than  -(w-w0pt)* 

Moreover,  the  presence  of  4>  in  Equation  (18)  causes  the  slope  of  the 
o 

z (t)-surface  to  influence  the  speed  of  response. 


GRADIENT 

TRAJECTORY 


PREFERRED 

TRAJECTORY 


Figure  Constant  i'  in  the  w-plane. 

Clearly,  a better  strategy  would  be  to  eliminate  the  $ from  the 
right  hand  side  of  Equation  118),  i.e.,  to  control  the  weights  accord- 
ing to  the  equation 

J?  * <19> 

If  this  were  done,  the  weights  would  move  directly  toward  wQDt  and 
the  eigenvalues  of  <t>  would  not  influence  the  speed.  To  see  how  such 
a control  law  may  be  realized,  we  note  from  Equation  (17)  that 


(20) 


w-wopt  = 7 *'1^wc7(tj]  . 

Hence  Equation  (19)  is  the  same  as 

gif  = -k  $ [c2(t)]  , (21) 

or  equivalently, 

4>  7ft  = -kv  w Ee^(t)]  • (22) 


We  will  refer  to  this  as  the  ideal  control  law  for  the  adaptive  array. 
It  differs  from  the  LMS  algorithm  only  in  the  presence  of  the  matrix  * 
multiplying  dw/dt.  In  the  next  section,  we  describe  a feedback  loop 
that  implements  this  equation. 

IV.  A MODIFIED  FEEDBACK  LOOP 


When  Equation  (2)  is  substituted  in  Equation  (3),  the  LMS  algo- 
rithm becomes 


dw- 


» 2kXj (t)  R(t) 


I 


2M 

A 


(23) 


Let  us  consider,  instead  of  this,  the  control  law 


dw- 

W 


r 


= 2k  A < 


x^t) 


2M 

R(t)  - I 
j=l 


In  this  equation,  c is  a gain  constant  and  A { - } represents  an  averaging 
operation  to  be  defined  below.  This  equation  corresponds  to  the  feed- 
back loop  shown  in  Figure  3.  This  loop  is  similar  to  that  in  Figure 
1,  except  for  the  inclusion  of  the  averaging  operation  A{»)  and  the 


1 


j 


extra  amplifier,  summer  and  multipliers  to  form 
2M  dw, 

c L xj(t) 

and  subtract  it  from  the  reference  signal. 


OTHER  XjWj  TERMS 


Figure  3.  The  modified  feedback  loop. 

We  define  the  averaging  operation  A{.}  as  a finite  time  average. 
We  assume  the  weights  are  slowly  varying  in  comparison  to  the  signals 
x.(t)  and  R(t) . We  let  A{.}  represent  a time  average  over  an  interval 
short  enough  that  w . and  dw./dt  may  be  considered  constant  over  this 
interval,  but  long  compared  to  the  carrier  cycles  of  x.(t)  and  R(t). 
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The  actual  value  of  the  time  interval  to  be  used  and  the  reasons  for 
including  this  averaging  in  the  loop  will  be  discussed  below.  For 
the  moment,  we  settle  for  this  definition,  which  allows  us  to  make 
the  approximation 

f 2M  dw,  'I  2M  dWj 

A|x,(t)  ^ xjft)  tflj  »<x,<t)  XjftH  ^ . 

(25 

Since  the  right  side  of  Equation  (23)  is  simply  -k  vje  (t)],  we  may 
also  write 

2M  1L  o 

2k  A )X.(t)  R(t)  - l x.(t)w.  f - -kV  IA  (eZ(t)}]  . 

v J 1 


Equation  (24)  may  then  be  expressed  in  matrix  form  as 

Cl  + 2kcA  {XXT}3  = .k7w  [A  (e2(t)}]  . (2 

To  understand  why  the  feedback  loop  in  Figure  3 is  useful,  let 
us  suppose  for  the  moment  that  the  averaging  operation  A{ - } is  good 
enough  that 

A {XXT}  = * (2 


A (e2(t)}  * e*(t)  (29 

2 T 2 

where  « and  c (t)  denote  the  infinite  time  averages  of  XX  and  e (t). 

Then  Equation  (27)  becomes 


& + 2kc  ♦]$?  = -kvw  [ e?(t)  ] , 


(30) 


which  is  similar  to  the  ideal  control  law  in  Equation  (22),  except 
for  the  extra  term  I on  the  left.  To  see  how  the  weights  behave  under 
this  equation,  we  collect  all  terms  involving  w on  the  left  side. 

Since 


7w[c2(t)]  =2[*w-S]  (31) 

(see  Equation  (12a)),  we  have 

[I  + 2kc  4>]  ^ + 2k4>w  = 2kS  . (32) 


Now  a typical  weight  has  the  solution 


2kx 


1 


w.(t)  = Ai  e 
1 \ 


The  jth  time  constant  in  this  transient  response  is 


l+2kcX- 


2k\  2 

l+2kcx. 


2kx 


2M 


T+KE\ 


2M 


+ A.  e 


+ •*•  + A.  e 
12M 


+ c1# 


(33) 


l+2kcXj 
T j = 2k  Xj 


(34 


which  may  be  compared  with  Equation  (10)  for  the  IMS  algorithm.  We 
find  that  now,  as  Xj  becomes  large,  tj  does  not  become  arbitrarily 
small  as  in  Equation  (10)  but  is  bounded  below  by  c.  By  choosing  c 
properly,  we  may  limit  the  fast  response  speed  of  the  array  without 
limiting  the  signal  ratio  I/N. 

The  steady-state  solution  of  Equation  (8),  the  LMS  algorithm, 
is 

w = S,  (35) 


12 


I 


0 


u 


u 


u 


which  is  known  to  be  the  optimal  solution  (1).  We  note,  however,  that 
Equation  (32)  has  the  same  steady-state  solution,  regardless  of  the 
value  of  c,  so  it  also  yields  optimum  weights. 

The  difference  between  the  IMS  algorithm  and  Equation  (32)  is 
in  their  transient  behavior.  In  particular,  if  c is  large  enough  that 


2kc  Aj  > 1 


(36) 


for  every  eigenvalue  Aj.  Equation  (32)  may  be  approximated  by 


2k$[  c $£  + w]=  2kS  , 


(37) 


or  simply 


dw 

c¥f  + w 


S , 


(38) 


0 

0 

0 

D 


which  is  equivalent  to  the  ideal  control  law  in  Equation  (22).*  In 
this  case,  all  components  w..  have  the  same  time  constant,  c.  There 
is  only  one  time  constant  in  the  array  response,  and  it  is  independent 
of  signal  power. 

Equation  (30)  differs  from  the  ideal  control  law  because  of  the 
extra  term  I on  the  left.  This  difference  means  that  when  the  array 
receives  weak  signals,  so  2kc<J>  Is  negligible  compared  to  I,  Equation 
(30)  becomes  the  LMS  algorithm.  With  strong  signals  and  large  2kc$, 
the  I term  is  negligible  and  Equation  (30)  becomes  the  ideal  control 
law.  For  in  between  cases,  there  will  still  be  some  spread  in  time 
constant  if  2kcAj  < 1 for  some  Aj.  But  with  the  loop  modified  as  shown 
in  Figure  3,  the  shortest  time  constant  is  dictated  by  c rather  than 
by  the  strongest  signal. 


♦Substitute  Equation  (31)  into  Equation  (22)  to  obtain  this  form. 


13 


An  additional  remark  is  helpful  for  understanding  the  control 
loop  in  Figure  3.  If  Equation  (34)  is  compared  with  Equation  (10), 


we  see  that  each  x.  for  the  new  feedback  loop  is  larger  than  the  cor- 

J 


responding  T.  for  the  LMS  loop.  Therefore,  when  the  modifications 

J 


shown  in  Figure  3 are  added  to  the  LMS  loop,  the  result  is  to  slow 
down  the  response  time  of  the  array.  To  obtain  a fixed  speed  of  re- 
sponse from  the  array,  c is  chosen  large  enough  that  the  fast  time 
constant  terms  in  the  LMS  loop  are  slowed  down  until  they  are  of  the 
same  speed  as,  or  slower  than,  the  slow  terms  in  the  LMS  loop.  The 
modified  loop  in  Figure  3 is  thus  slower  than  the  LMS  loop,  but  has 
the  advantage  of  fixed  time  constants.  Constancy  of  speed  of  response 
is  much  more  important  for  system  design  purposes  than  obtaining  the 
fastest  possible  response.  Of  course,  the  real  time  speed  of  response 
of  a hardware  implementation  would  be  adjusted  to  a suitable  value 
by  choosing  gains  appropriately. 


We  now  return  to  the  averaging  operation  A{.}  in  Equation  (24). 
A{*}was  defined  as  a finite  time  average  over  an  interval  short  com- 
pared to  changes  in  wi  and  dw^/dt,  but  long  compared  to  the  fluctu- 
ations of  x^t)  and  R(t).  We  now  elaborate  on  this  definition. 


Let  us  rewrite  Equation  (26)  in  the  form 


ZM  ZM 

2k  A”  xi(t)  R(t)  - J1  xj(t)Wj  ’ = 2k  A{x.(t)R(t)  } - 2k  J ^ A fxi (t)xj(t) } 


Using  this  and  Equation  (25)  in  Equation  (24),  we  find  that  the  weights 
in  the  modified  loop  satisfy  the  system 


[ I + 2kc  A <XXT  1]  + 2k  A {XXT}  w = 2k  A (XR(t) } . (40) 


First,  we  observe  that  the  matrix  A { XXT}  multiplying  dw/dt  must 
be  nonsingular  if  the  modified  loop  Is  to  have  the  desired  behavior. 
To  see  why  this  is  so,  assume  for  the  moment  that  the  matrix  A {XXT} 
can  be  approximated  by  a constant  matrix,  and  make  a rotation  of  co- 
ordinates in  Equation  (40)  into  the  principal  axes  of  A {XXT }.  Let 


w - Bn  , (41) 

where  B is  a 2M  x 2M  orthogonal  coordinate  rotation  matrix  and  n is 
the  weight  vector  expressed  in  the  principal  axes  of  A {XXT } (the  "normal" 
weight  vector).  Let 

A*  = BT  A {XXT } B 


be  the  matrix  of  eigenvalues  of  A (XXT }.  After  rotating  coordinates, 
we  find  that  the  jth  normal  weight  t^.  satisifes  the  differential  eq- 
uation 


where  q^ 


dp-i 

(l+2kcxj)  -ft  + 2kXj  Tij  = 2kq^, 

is  the  jth  component  of  the  column  vector  Q: 


(43) 


Q = BT  A {XR ( t ) } . 


(44) 
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As  long  as  2kcx*  >1,  we  see  that  the  time  constant  for  rij  will  be 

approximately  c.  For  any  given  set  of  A*,  we  can  assure  that  all 

transients  in  the  array  response  have  time  constant  c by  choosing  c 

large  enough  that  2kcA*  > 1 for  all  A*,  including  the  smallest  one. 

J *3 

Clearly  it  will  be  possible  to  do  this  only  if  the  smallest  eigen- 
value is  not  zero.*  If  A fXXT } has  any  zero  eigenvalues,  the  feedback 
loop  modification  in  Figure  3 will  not  have  the  intended  effect. 

These  remarks  make  it  clear  that  some  averaging  is  definitely 
necessary.  For,  without  averaging, 

A{XXT}=XXT,  (45) 

and  the  matrix  XXT  is  always  of  rank  1.  (X  is  an  eigenvector  of  XX^ 
with  eigenvalue  XTX.  Any  other  vector  orthogonal  to  X is  an  eigen- 
vector with  eigenvalue  0.  Hence  XXT  always  has  2M-1  zero  eigenvalues.) 
We  should  not  expect  fixed  time  constants  in  this  case.** 


*A{XXT}  is  positive  semidef inite,  so  all  A*  ^0. 

**If  the  averaging  is  omitted,  the  weights  satisfy  the  system  obtained 
by  substituting  Equation  (45)  in  Equation  (40): 

[ I+2kcXXT  ] + 2kXXTw  = 2k  XR(t) 

This  may  be  rearranged  by  multiplying  on  the  left  by  the  inverse 


[ I+2kcXXT]_1 
which  yields 


2kc 

l+2kcXrx 


dw 


+ 


■ 2k'  y I *XTw 

l+2kcX  X J 


2k 

l+2kcXTX 


XR(t) 


Comparing  this  with  Equation  (4)  for  the  LMS  algorithm  shows  that  the 
only  difference  between  the  two  is  that  the  gain  constant  2k  in  the 

2k 

LMS  loop  is  replaced  by  the  quantity  in  the  modified  loop. 

T l+2kcX  X 

As  long  as  2kcX  X > 1,  the  effect  of  this  change  is  simply  to  normalize 
the  loop  gain  of  the  modified  loop  to  XX,  the  total  power  in  the  ar- 
ray. This  has  the  effect  of  fixing  the  fastest  time  constant  in  the 
array,  but  does  not  solve  the  problem  of  time  constant  spread. 
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Next,  with  A {•}  defined  as  a finite  time  average,  we  must  deter- 
mine what  averaging  time  is  required  to  make  all  the  eigenvalues  non- 
zero. This  question  is  most  easily  answered  by  considering  the  problem 
in  discrete  form.  Suppose  the  signals  in  the  array  are  sampled  every 
AT  seconds.  Let  denote  the  sample  of  vector  X, 

x?(jAT) 
xi  * •• 

yx2H(jAt)  J 

A finite  time  average  of  XXT  over  an 
by  an  average  of  K samples  of  XX^: 

A{XXT}  * y XXTdt  » £ 


(46) 


interval  T can  be  approximated 


K T 

I xixi  • 
j*l  J J 


(47) 


r 


i 1 


where  T * KaT.  Clearly,  at  least  2M  samples  are  required  to  make 
A{XXT}  nonsingular.  I.e. , the  matrix  X^xJ  is  of  rank  1,  l/2(X^xj+ 
Xj,xl)  is  of  rank  2 (if  X^  and  X2  are  not  collinear)*,  1/3(XjXj+X2X2+ 
X3Xj)  is  of  rank  3 (if  Xj,  X2  and  X^  are  not  coplanar),  and  so  forth. 
Hence  to  be  nonsingular,  the  matrix 


K X Vj  <48> 

must  contain  at  least  2M  samples  (i.e.,  K >_  2M).  For  K*2M,  the  matrix 
will  be  nonsingular  as  long  as  the  X^  are  linearly  independent. 

To  make  the  vectors  Xi  independent,  it  is  sufficient  that  the 
sampling  times  for  the  X^  be  far  enough  apart.  Since 

*We  can  always  find  2M-2  vectors  orthogonal  to  both  X.  and  X2,  so  there 
will  always  be  2M-2  zero  eigenvalues  for  1/2(XjXJ+X2X2). 
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xlxj  * y xk(1AT)Xk(jAT), 


(49) 


we  have 


(50) 


where  E{*}  denotes  the  expectation  and  Rx 
function  of  xk(t). 


k 


(t)  is  the  autocorrelation 


Rx  (t)  = E{xk(t)xk(t+x) } . 


(51) 


If  the  sampling  time  AT  is  large  enough  that  all  the  terms  Rx  [(j-i)AT  J 

are  small,  then  E{xlx.}  is  small,  and  X.  and  X.  are  nearly  orthogonal, 

» J 

on  the  average.  The  value  of  AT  required  to  make  Rx  ( t)  =0  may  be 
determined  from  the  spectral  density  of  the  signals  &k(t).  For  ex- 
ample, suppose  the  signals  have  flat  power  spectral  density  Sx(uj)  of 
PQ  watts/radian  per  second  over  a bandwidth  of  B Hz.,  as  shown  in 
Figure  4: 


V - »0B  ^ cosV  , 


so  we  can  insure  that  on  the  average  the  vectors  xi  are  orthogonal 
by  choosing 

• < 
Since  at  least  k=2M  samples  of  X will  be  required  to  make 


i K T 

1?  ^ XjXj 

* j=l  J J 


nonsingular,  the  time  interval  used  in  Equation  (47)  should  be  approxi- 
mately 


r • 


i.e. , 


Af  XXT}  = 


XXT  dt 


We  may  also  express  the  required  averaging  time  in  terms  of  carrier 
cycles.  Since  the  carrier  period  is 


To  = 7"  * 


where  f is  the  carrier  frequency  in  Hz.,  we  have 


wy  'o 


Note  that  B/f  is  the  fractional  bandwidth, 
o 
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In  practice,  simulations  of  Equation  (24)  indicate  that  the  av- 
eraging time  can  be  somewhat  smaller  than  this  amount.  The  reason 
is  that  to  make  A {XXT } nonsingular  requires  only  linear  independence 
of  the  X.j , not  orthogonality.  The  value  of  AT  given  in  Equation  (53) 
makes  the  Xi  orthogonal,  which  is  a stronger  condition.  In  general, 
one  finds  that  as  the  averaging  time  is  reduced,  c must  be  made  larger 
to  maintain  2kcAj  > 1 for  the  smallest  eigenvalue.  The  smallest  eigen- 
value goes  to  zero  as  the  averaging  time  is  reduced. 

V.  AN  EXAMPLE 


Now  we  give  a simple  example  to  illustrate  the  behavior  of  the 
feedback  loop  in  Figure  1.  Consider  a two-element  array  of  omnidi- 
rectional elements  with  four  quadrature  weights,  as  shown  in  Figure 
5.  We  assume  a CW  desired  signal  of  amplitude  Ad  is  incident  on  the 
array  from  broadside  at  frequency  uiQ.  We  also  assume  a double  side- 
band, suppressed  carrier  AM  interference  signal  of  amplitude  A^,  car- 
rier frequency  co0,  and  modulation  frequency  is  incident  from  an 
angle  0^  off  broadside.  The  resulting  signals  in  the  array  are 

xl(t)  = Adcosa>0t  + Aicosumt  cos(o)0t-<t>.), 

x2(t)  = Adsinajot  + A^cosd)mt  sin(oi0t-<}> - ) , (58) 

x3(t)  = Adcosa)0t  + A.jCOSa)mt  cosa,0t, 
and 

x4(t)  = Adsinu)Qt  + A^osu^t  sin^t. 


where 


(59) 


L is  the  element  spacing  and  c is  the  velocity  of  light.*  We  let  the 
reference  signal  be 


*This  c is  unrelated  to  the  gain  constant  c defined  earlier. 
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COSu)  T 


DESIRED 

SIGNAL 


INTERFERENCE 


QUADRATURE 

HYBRID 


QUADRATURE 

HYBRID 


Figure  5.  A two-element  array 


The  array  weights  satisfy  Equation  (40).  To  determine  typical 
weight  transients,  we  have  solved  these  equations  numerically  using 
a discrete  (difference  equation)  approximation,  as  follows.  All  quan 
tities  in  the  equation  are  sampled  array  AT  seconds.  We  let  w(1)  be 
the  i*^  sampled  value  of  the  weight  vector.  We  approximate 


Substituting  this  in  Equation  (40)  yields  an  equation  for  A*(j) 

D + 2kcAJ{XXT)  D Aw(j)  = 2k  ATAj  {X  [ R(t)-XTw]}  , 

where  Aj  f • } denotes  the  average  of  the  quantity  In  brackets  a 
jth  sample.  A ^ } is  computed  as  a moving  average  over  the  las 

samples;  i.e.. 


A,-  {XXT } = — 1 


k=j-J+l 


A.{X[R(t)-XTw]}  = i \ X.  [R  -xjw(k)]  , 
3 J k=j-J+l  K K K 


where  Xk  and  R k are  the  k sampled  values  of  the  signal  vector  X and 
the  Reference  Signal  R(t).  At  each  iteration,  the  averaged  quantities 
in  Equations  (63)  and  (64)  are  computed,  the  simultaneous  equations 
for  Aw(j)  are  solved,  and  the  resulting  Aw(j)  is  added  to  w(j)  to  pro- 
duce the  new  value  of  the  weight  vector  for  the  next  iteration.  This 
iterative  process  is  continued  until  w(j)  is  determined. 

Figures  6,  7 and  8 show  a typical  set  of  weight  transients,  com- 
puted for  the  parameter  values 

Ad  = 3 
2k  = .05 


AT  = — - (4  samples/carrier  cycle) 

2u)„ 


= Tt(half-wavelength  element  spacing) 


9i  = 30 
wm  = °'5wd 

and  A(*}  is  an  average  of  8 samples  (J=8).* 


♦Note  that  according  to  Equation  (57),  the  averaqing  time  should  be 
4 carrier  cycles  or  16  samples,  since  we  sample  4 times  per  carrier 
cycle.  However,  simulation  results  indicate  that  an  8 sample  average 
is  adequate  in  this  case. 
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Figure  8.  Weightytranslents  with  A 


Figure  6 shows  the  weight  transients  that  result  when  A^O  (i.e., 
when  there  is  no  interference).  Figure  7 shows  the  transients  when 
A. =30,  and  Figure  8 shows  them  when  A. =3000.  In  all  cases,  the  weight 
vector  starts  from  an  arbitrary  value  of 


w 


( 1\ 
1 
1 

w 


Comparison  of  Figures  6,  7 and  8 shows  that  in  all  three  cases 
the  weight  transients  proceed  with  essentially  the  same  time  constant. 
None  of  the  parameters  in  the  feedback  loops  have  been  changed  from 
one  figure  to  the  next.  The  only  change  is  the  interference  amplitude, 
which  is  seen  to  have  no  effect  on  the  speed  of  response  of  the  loops. 
This  constant  speed  of  response  is  the  behavior  we  set  out  to  obtain. 


VI.  CONCLUSIONS 


An  improved  feedback  loop  for  adaptive  arrays  has  been  presented. 
This  loop  yields  the  same  steady-state  weights  as  the  LMS  algorithm, 
but  has  the  advantage  that  its  time  constants  are  essentially  indendent 
of  signal  power.  Use  of  this  loop  should  simplify  design  constraints 
that  arise  because  of  dynamic  range  requirements. 

The  modified  feedback  loop  is  shown  in  Figure  3.  This  loop  In- 
cludes an  averaging  operation,  defined  by 

A (f (t)  } = — f*  f(n)dn. 

T Jt-T 


An  averaging  time  of  approximately 


HSW*'**®** 


is  adequate  to  make  the  system  have  the  desired  behavior,  where  M is 
the  number  of  array  elements,  B/fQ  is  the  fractional  bandwidth,  and 
Tq  is  the  carrier  period. 


As  a closing  remark  we  comment  that  the  feedback  modifications 
shown  in  Figure  3 can  also  be  used  with  an  array  of  the  type  originally 
described  by  Applebaum  (5).  In  this  case,  the  reference  signal  in 
Figure  3 is  eliminated  and  the  main  beam  direction  is  controlled  by 
adding  an  appropriate  steering  vector  component  to  each  weight.  This 
type  of  array  is  useful  when  the  desired  signal  angle  of  arrival  is 
known  in  advance. 
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